BioNLP'09 Shared Task on
Event Extraction
in conjunction with BioNLP, a NAACL-HLT 2009 workshop, June 4-5 2009, Boulder, Colorado
[Shared Task Home] [Evaluation Methods] [Master Result Table] [Team Profiles] [System Profiles]

Final Evaluation Results
on Transcription events by Approx. Span matching

Task 1

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[ UTurku  ]        Transcription         137 (   54)       78 (   54)    39.42    69.23    50.23
[VIBGhent ]        Transcription         137 (   54)       89 (   54)    39.42    60.67    47.79
[JULIELab ]        Transcription         137 (   49)       79 (   49)    35.77    62.03    45.37
[ UTokyo  ]        Transcription         137 (   49)      104 (   49)    35.77    47.12    40.66
[ UAveiro ]        Transcription         137 (   46)      112 (   46)    33.58    41.07    36.95
[  NICTA  ]        Transcription         137 (   31)       43 (   31)    22.63    72.09    34.44
[ Team 24 ]        Transcription         137 (   38)       89 (   38)    27.74    42.70    33.63
[  UNSW   ]        Transcription         137 (   40)      103 (   40)    29.20    38.83    33.33
[  SCAI   ]        Transcription         137 (   32)       62 (   32)    23.36    51.61    32.16
[UAntwerp ]        Transcription         137 (   34)       82 (   34)    24.82    41.46    31.05
[CNBMadrid]        Transcription         137 (   67)      339 (   67)    48.91    19.76    28.15
[ UNIMAN  ]        Transcription         137 (   21)       31 (   21)    15.33    67.74    25.00
[ConcordU ]        Transcription         137 (   21)       35 (   21)    15.33    60.00    24.42
[ASU+HU+BU]        Transcription         137 (   22)       52 (   22)    16.06    42.31    23.28
[CCP-BTMG ]        Transcription         137 (   18)       20 (   18)    13.14    90.00    22.93
[ UZurich ]        Transcription         137 (   31)      148 (   31)    22.63    20.95    21.75
[  PIKB   ]        Transcription         137 (   19)       38 (   19)    13.87    50.00    21.71
[UT+DBCLS ]        Transcription         137 (   23)       77 (   23)    16.79    29.87    21.50
[   Cam   ]        Transcription         137 (   17)       30 (   17)    12.41    56.67    20.36
[ USzeged ]        Transcription         137 (   28)      150 (   28)    20.44    18.67    19.51
[ Team 09 ]        Transcription         137 (   16)       47 (   16)    11.68    34.04    17.39
[  UMich  ]        Transcription         137 (   66)      696 (   66)    48.18     9.48    15.85
[ KoreaU  ]        Transcription         137 (   12)       43 (   12)     8.76    27.91    13.33
[CIPS-ASU ]        Transcription         137 (   17)      133 (   17)    12.41    12.78    12.59

Task 2

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[ Team 24 ]        Transcription         137 (   38)       89 (   38)    27.74    42.70    33.63
[UAntwerp ]        Transcription         137 (   34)       82 (   34)    24.82    41.46    31.05
[CNBMadrid]        Transcription         137 (   67)      339 (   67)    48.91    19.76    28.15
[ASU+HU+BU]        Transcription         137 (   22)       52 (   22)    16.06    42.31    23.28
[CCP-BTMG ]        Transcription         137 (   18)       20 (   18)    13.14    90.00    22.93
[UT+DBCLS ]        Transcription         137 (   23)       77 (   23)    16.79    29.87    21.50

Task 3

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------